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Abstract. Let 9 be a finite dimensional real Lie algebra. Let p : g — > End(V) be a rep- 
resentation of g in a finite dimensional real vector space. Let Cy = (End(V) i S>S(q)) b 
be the algebra of End(V)-valued invariant differential operators with constant coeffi- 
cients on g. Let U be an open subset of g. We consider the problem of determining the 
space of generalized functions <f> on IA with values in V which are locally invariant and 
such that Cy4> is finite dimensional. 

In this article we consider the case g = st(2,lR). Let M be the nilpotent cone of 
s[(2,R). We prove that when U is SL(2, R)-invariant, then (f> is determined by its 
restriction to U \ J\f where 4> is analytic (cf. Theorem 6.1). In general this is false when 
U is not SL(2, R)-invariant and V is not trivial. Moreover, when V is not trivial, </> 
is not always locally L 1 . Thus, this case is different and more complicated than the 
situation considered by Harish-Chandra (cf. [HC64, HC65]) where g is reductive and 
V is trivial. 

To solve this problem we find all the locally invariant generalized functions supported 
in the nilpotent cone J\f. We do this locally in a neighborhood of a nilpotent element 
Z of g (cf. Theorem 4.1) and on an SL(2, R)-invariant open subset U C st(2,M) 
(cf. Theorem 4.2). Finally, we also give an application of our main theorem to the 
Superpfaffian (cf. [Lav04]). 

1. Introduction 

Let g be a finite dimensional real Lie algebra. Let p : g — > End(V^) be a representation 
of g in a finite dimensional real vector space. Let C v = ( End(V) <g> S(g)) s be the algebra 
of End(V^)-valued invariant differential operators with constant coefficients on g. It is 
the classical family algebra in the terminology of Kirillov (cf. [KirOO]). Let U be an open 
subset of g. We consider the problem of determining the space of generalized functions 4> 
on U with values in V which are locally invariant and such that Cv4> is finite dimensional. 

When V — M is the trivial module and g is reductive, the problem was solved by 
Harish-Chandra (cf. in particular [HC64, HC65]). Let be a locally invariant generalized 
function such that S(g) s <p is finite dimensional. He proved that <p is locally L l , <p is 
determined by its restriction <j)\ g > to the open subset g' of semi-simple regular elements 
of g and <f>\^ is analytic. 

In this article we consider the case g = st(2,R). Let M be the nilpotent cone of 
sl(2,R). In this case g' = $1(2, R) \ J\f. Let be a locally invariant generalized function 
on U with values in V such that Cv<f) is finite dimensional. We prove that when U is 
SL (2, K)-invariant, then is determined by its restriction to U \ M where is analytic 
(cf. Theorem 6.1). In general this is false when IA is not SL(2, M)-invariant and V is not 
trivial. Moreover, when V is not trivial, <ft is not always locally L 1 . Finally, we also give 
an application of our main theorem to the Superpfaffian (cf. [Lav04]). 
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To solve the problem we find all the locally invariant generalized functions supported 
in the nilpotent cone J\f. Let V n be the n + 1-dimensional irreducible representation of 
sl(2,R). Let U be an open subset of st(2,R). We denote by C'°°(U, K) S[(2 ' R) the set 
of locally invariant generalized functions on U with values in V n . Let □ be the Casimir 
operator on g. 

We denote by Af + (resp. Af~) the "upper" (resp. "lower") half nilpotent cone (cf. 
4.1). We put: 

(1) S° n (U) = {0GC-°°(W,V;) s({2 ' R) /0U { o} = O}; 

(2) S±(U) = {0GC-°°(W,V;) s[{2 ' M) /0U(Ar ± u { o}) = O}; 

(3) S n (U) = {0eC- oo (W,K) s[{2 ' R) /0bw = O}. 

Let Z G A/" + . We assume that U is a suitable open neighborhood of Z (cf. section 
4.6). Let 5\r± be an invariant generalized function with support A/' ± U {0} (cf. section 
4.4). We construct an invariant function s n on Af H U with values in V n . We prove (cf. 
Theorem 4.1): 

(i) When n is even, S n (U) is an infinite dimensional vector space with basis: 

( 4 ) ( Dfc M^+)W 

(ii) When n is odd, dim(S n (U)) = and a basis is given by: 

(5) (□ fc ( S „cW + ))o< fe <ii-- 

We assume that U is an SL(2, M)-invariant open subset of sl(2, R). If W n N ^ 0, we 
have M + cWor A/" - C W. We prove (cf. Theorem 4.2): 

0) 

's° n (U) = {0} ifO^W; 
~ {V n ® 5(sl(2, M))) s[ ( 2 « if e W. 

(ii) When n is even, we have: 

(7) S n {U) = S° n (U)®Vect{D k ( Sn 8 M+ )\u/keN}®Yect{n k (s n 5 M -)\ u /keN} 

(8) S^U) = S n (U)®Vect{n k (s n 5 M ±)\ u /keN} 

(iii) When n is odd: 

(9) $>(W) = S±(W) = SS(W) 



(6) 



Finally, let W be an open subset of sl(2, R). Let V be the space of a real finite 
dimensional representation of $j. Let be an invariant function defined on U such that 
Cy(f) is finite dimensional. This last condition is equivalent to the existence of r e N and 
(a , • • • , a r -i) G R r such that: 

r-l 
k=0 

Moreover, we assume that (f)\u\N — 0- We prove (cf. Theorem 5.3) that if U is SX(2,R)- 
invariant, then we have = 0. 
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In general, when U is not SL(2, M)-invariant, there exist non trivial solutions of the 
equation \3 k <f) = which are supported in the nilpotent cone (cf. Theorem 5.2). 

Acknowledgment: I wish to thank Michel Duflo for many fruitful discussions on the 
subject and many useful comments on preliminary versions of this article. 
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Let be a finite dimensional real Lie algebra. Let p : g — > End(V) be a representation 
of g in a finite dimensional real vector space V. Let U be an open subset of g. We denote 
by Vf(]A) the space of compactly supported smooth densities on U. We put: 

(10) C-°°{U,V)=C{V™{U),V), 

where C stands for continuous homomorphisms. It is the space of generalized functions on 
U with values in V. We put C _0O (W) = C _00 (W, R). For <p e C _00 (W, V) and /i G P~(W), 



2. Notations 

Let g be a finite dimensional real Lie algebra. Let p : g — > End(V) be a repr 
of g in a finite dimensional real vector space V. Let U be an open subset of g. 
by Vf{U) the space of compactly supported smooth densities on U. We put: 

(10) C-°°{U,V)=C{V™{U),V), 

where C stands for continuous homomorphisms. It is the space of generalized fu 
U with values in V. We put C _0O (W) = C _00 (W, R). For e C _0O (W, V) and /i 
we denote by: 

(11) / 0(Z)rf/i(Z) 
the image of /i by 0. We have: 

(12) C-°°(U,V) =C-°°{U)®V 
(we will also write (pv for 4>®v). 
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Let Z G 0. We denote by dz the derivative in the direction Z. It acts on C~°°{U) 
and on C~°°(U, V). We extend d to a morphism of algebras from S(g) to the algebra of 
differential operators with constant coefficients on g. We denote by C z the differential 
operator defined by: 

(13) {C z <t>){X) = j t <t>{X-t[Z,X])\ t=Q . 

The map Z \— > £^ is a Lie algebra homomorphism from q into the algebra of differential 
operators on g. Let Z e g and <fi <g> t> G C~°°(U) <g> V , we put: 

(14) Z.{<j>®v) = <j)®p{Z)v + (Cz4>) ®f. 

In other words, if we extend £^ (resp. p(Z)) linearly to a representation of g in 
C-° C (W, V), we have for e C-°°(W, V): 

(15) Z.0 = (p(Z) + £ z )0. 

We say that G C~°°(U, V) is locally invariant if for any Z G g we have Z.0 = 0. We 
put: 

(16) c-°°(u, vy = {(f) g c-°°(u, v) I yz g 0, z.0 = o}. 

3. Support {0} distributions 

In this section we assume that g is unimodular. We choose an invariant measure dZ 
on g. We define the Dirac function 5 on with support {0} (which depends on the 
choice of dZ) by the following. Let C^°(g) be the set of smooth compactly supported 
functions on 0. Then: 

(17) V/GC c °°(fl), / 5o(Z)f(Z)dZ = f(0). 

We have the following well known theorem: 

Theorem 3.1. Let g be a finite dimensional unimodular real Lie algebra and V be a 
finite dimensional g-module. Then: 

(18) {0 G C-°°(0, V)y<f>\ gm = 0} ~ (V ® 

T/ie isomorphism (which depends on the choice ofdZ) sends Y^ v i®Di G (V ® S(g)) 5 to 

i 

E (dDi$o)vi. 



4. Support in the nilpotent cone 
From now on, we assume that = sl(2, M). 
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We denote by (ft,x,y) G (s[(2,R)*) the dual basis of (iJ,X,F). Thus: 

ft. x 

y 



(20) 



^ esl(2,R)*®sl(2,[ 



is the generic point of 5[(2,R). Let M be the nilpotent cone of s((2,R). It is the union 
of three orbits: 

(i) {0}. 

(ii) the half cone Af + with equations ft 2 + xy = 0; x — y > 0. 

(iii) the half cone M~ with equations h 2 + xy = 0; x — y < 0. 

We denote by □ the Casimir operator of sl(2,R): 

(21) n = ^(d H ) 2 + 2d Y d x . 

It is an invariant differential operator with constant coefficients on st(2, R). 

Let V\ = R 2 be the standard representation of sl(2, R). We denote by (e = (1,0),/ = 
(0, 1)) the standard basis of R 2 . The symplectic form B such that B(e, /) = 1 is st(2, R)- 
invariant. For v G V 1: we define Hi(v) G sl(2,R) as the unique element such that: 

(22) VZ G 5l(2, R), tr0/i(u)Z) = Zu). 
It defines a (moment) map: 

(23) fix : Vi ->«[(2,R). 

We have //i(e) = \X and //i(/) = — \Y. The function /ii is a two-fold covering of A/" + 
byVxUO}. 

Let Zq G jV\{0}. Let U be a "small" neighborhood of Z . In this section we determine: 

(24) {<peC^(U,Vr^/<P\ u \ M = 0}. 
We can assume that Z = X G A/" + . 

4.2. Restriction to X + RY\ We define a map: 

7T : SL{2, R) x (X + RY) -> st(2, R) 

(25) (<?,Z)^A%)(Z). 

This map is submersive. Let J 2 be the identity matrix in SL(2, R). Let Ax C X + RF 
be an open interval containing X. We choose a connected open subset V C SX(2,R) 
such that J 2 G V. We put: 

(26) W = tt(VxA x ). 
It is an open neighborhood of X in q. 
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Lemma 4.1. There is an injective (restriction) map: 

3 X : c-°°(u, vr [(2 ' R) - c-°°(a x , V) 

>-»• 0X- 

Proof. The map 

(28) 7r w = 7r|vxA x : Vx A X ^W 

is a submersion. Thus if G C~°°(U, V), then vr^(0) is a well defined generalized function 
on V x Ax with values in V. Moreover, 

(29) = 0^ vr* (0) = 0. 

Now, we assume that is locally invariant. Then, 7r^(0) is also locally invariant and 

(30) vr*(0)GC oo (V)gC- oo (A x ). 

(Where <g> is a completed tensor product.) Thus 7r^(0) can be restricted to {I 2 } x Ax C 
V x Ax (cf. [HC64]). We identify A x and {/ 2 } x A x . We put: 

(31) 0x = ^(0)| Ax . 
Since V is connected and is locally invariant, we have: 

(32) 7T* u ( ( j ) )(g,Z) = p(g) ( f )x (Z)- 
Thus 

(33) X = O^7T*(0) = O. 

□ 

We have for Z G sI(2,R): 

(34) £ z = -hd\z,H\ ~ xd[z,x] ~ yd[ Z ,Y]- 
In particular: 

(35) £ w = -2x9x + 2 2 /,9 y ; 

(36) £x = 2hd x -yd H ; 

(37) £ y = xd H -2hdy. 

If V is sufficiently small, we have x ^ on U. We assume that this condition is realized. 
It follows that on U we have: 

d x = -^-C H + -dy; 

(38) 1 2x 2h x 

d H = -Cy H dy. 

X X 



We have Ax C {X + yY / y E K}. We use the coordinate y\ Ax , still denoted by y, on 
Ax- Let -0 G C"°°(Ax, K)- We put ip(y) = ip(X + yY). 
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Lemma 4.2. We have: 



(39) 3 X (C-~(W, \/)< 2 «) = G C-°°(A X , V) / (p(X) + yp{Y))^y) = 0}. 

(40) J x : C-~(W, V) s( ( 2 « - G C-°°(A X , V) / (p(X) + yp{Y))^(y) = 0} 
zs an isomorphism 

Proof. Since x| Ax = 1 and /i| Ax = we have for G C~°°(U, V)^ 2 '^: 

(41) {£x<£) x (y) = -y{d H <t>) x (y); 

and (C Y (f>) x (y) = (d H (f) x (y). 

It follows that we have: 

(42) {C x <f ) ) x (y)+y{Cy ( f ) ) x (y) = 0. 

Let ^ G 3x(c _0O (W, \/) s[(2 ' M) ). Then, there is G C-°°(W, \/) sl(2 ' R) such that ^ = <j> x . 
We have: 
(43) 

(p(X) + yp{Y))^y) = (p(X)+yp(Y))My) 

= { P {X)<t>) x {y) + y{p{Y)<t>) x {y) + {C x <t>) x {y) + y{C Y <P) x (y) 

= ((p(X) + C x )^) x (y) + y((p(Y) + C Y )^) x {y) = 0. 



Let ip G C-°°(A X , V) such that (p{X) +yp(Y))^(y) = 0. We define $ G C-°°(V x A x ) 
by the formula: 

(44) 4>(g,y) = p(g)Hy)- 

Since p is a smooth function on SX(2,R) with values in GL(V), this is a well defined 
generalized function on V x Ax with values in V. 

Let (g,Z) G V x Ax- Let (g', Z') G V x A x such that M(g)(Z) = Ad(g')(Z'). 
Then, M((g')- l g)Z = Z'. We put G z = {g" G SX(2,R) / Ad(g")(Z) = Z}. For 
g" G SX(2,R), we have Ad(#")(Z) G A x ^ G G z . Then, the fiber of n u at (y, Z) is 
included in {(#', Z) / g^g' G Moreover, for Z G s((2,R), [Z, Z'\ = ^ Z G RZ. 

Thus, since V is connected, the condition (p(X) + yp(Y)^jip(y) = on Ax ensures that 
■0 is constant along the fibers of nu- Thus there is a well defined generalized function ip 
on U such that: 

(45) 7T* = £ 

It follows from the construction that (ip) x = fp- 

□ 



The hypothesis 4>\u\n = means that 0x is supported in {X} C Ax- 
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4.3. Radial part of □. In the neighborhood U of X defined in section 4.2: 

u= l -{d H f + 2d Y d x 

(46) 1 

= U-Cy + -dy) 2 + 2dy(^C H + V -dy) . 

2 y x x y 2x x 

We define the radial part of □ as the differential operator D x on C~°°(A X , V): 

(47) p x= (3 + / KJ7) + 2»£)! + i, ') a . 

This definition is justified by the following lemma: 
Lemma 4.3. Let G C~°°(U, \/) s[(2 ' R) , then we have: 

(48) (U<P) X = U x <j> x . 
Proof. Since x\& = 1 and h\& = 0, we have: 



(49) + 2 ^ { . p{H) ^ x) + ^ x+y{ ^ x ) 

= 5("« 2+2 |;)^ + ( p(ff)+2+2 4)| fe 

= (3 + p(H) + 2y— ) — X + -p(F) 2 0x = 



□ 



4.4. The Dirac function Sj^+ (resp. 5^-). Let dZ = dxdydh be the Lebesgue 
measure on $1(2, R). Let (e*,f*) G (V^*) 2 be the dual basis of (e, /). The Lebesgue 
measure dv = —2de* df* on V\ is $1(2, M) -invariant. We define an invariant generalized 
function 5j^+ (resp. <V-) on sl(2,M) and supported in A/" + U {0} (resp. Af~ U {0}) by: 

V 5 eC c °°(«l(2,R)), / 5 N+ (Z)g(Z)dZ d ^ [ go^(v)dv 



(50) J f m J 

(resp.V^ G C c °°(5l(2,R)), / b M -(Z)g(Z)dZ^ \ g o (-^(v^v). 

V Jsl{2,R) JVi J 

We put: 

(51) 5 X = (5 N+ ) X G C-°°(A X ). 

We still denote by dy the Lebesgue measure on Ax- It is invariant. Let g G C™(A X ). 
Then we have: 

(52) / 5 x (y)g(y)dy = g(0). 
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4.5. Irreducible representations. If V = V 1 © • • • © V n where V 1 is an irreducible 
representation of s((2,R), then we have: 



n 



(53) c-°°(u, V) = © <r°°(w, V 1 ), 

i=l 

every subspace being stable for s((2,R). Thus we can assume from now on that the 
representation of s[(2, R) in V is irreducible. 

We fix the Cartan subalgebra f) = M.H and the positive root 2h (we still denote by 
h its restriction to h). Let n G N. We denote by V n the irreducible representation of 
st(2, R) with highest weight nh. We have dim(l / n ) = n+ 1. We decompose V n under the 
action of M.H. We fix v e V n \ {0} a vector of weight — nh: 

(54) p(H)v = -nv . 

We put for < i < n: v j = p(X)*t> . We have p(X)t> n = and p(H)vi = {—n + 2i)vi. 
On the other hand, p(Y)v = and for 1 < % < n: p(Y)vi = (n — i + l)ivi-i. 

4.6. A basic function on Af + . We construct a function s n : U fl A/" + — > which is 
the basic tool to generate all the generalized functions we are looking for. 

4.6.1. Case n even. In this case V n is isomorphic to the irreducible component of S% (sl(2 
(under adjoint action of st(2,R)) generated by X2. From now on we will identify V n 
with this component. We denote by s n : H — > V n the invariant map defined by: 

(55) s n {Z)=Z y t. 

4.6.2. Case n — 1. We recall that p± : V± \ {0} — > A/" + is a two-fold covering with 
Pi(e) = |X. If W is a sufficiently small connected neighborhood of X, there exists a 
unique continuous section si of /^i in W fl A/" + such that sx(|X) = e. We have si : 
UHAf + -> Fi. It satisfies: 

(56) VZeWn pi(si(Z)) = z. 



4.6.3. Case n odd. More generally when n is odd, is isomorphic to the irreducible 
component of V\ © S^{s[{2 1 R)) generated by e©X Ii 2 _ . From now on we will identify 
V n with this component. Let U be the above neighborhood of X. We define a function 
s n : U n jV + -> K by: 



(57) VZ e unM + , s n (z) = s 1 (z)®z !L ^ e K- 

4.7. Basic theorem. Let W be an open subset of sl(2,R). We put: 

(58) 5 n (W) = {0GC-°°(W,K) s[(2 ' R) /0k^ = O}. 

Theorem 4.1. Let nGN. LetU be an open connected neighborhood of X such that the 
function s n is well defined on U fl Af (cf. section 4-6) and 3x is bijective (cf. section 
4.2). Then: 

(i) When n is even, S n (U) is an infinite dimensional vector space with basis: 

(59) {n k ( Sn 5 M+ )) km . 

(ii) When n is odd, dim(<S n (Z/)) = rj -^- and a basis is given by: 

(60) (□ fc (Sn<W + )) 0<fe <^- 
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Remark: Since 5j^+(Z)dZ is a measure on 5((2,R) with support J\f + U {0} and s n 
is a smooth function on U fl Af with values in V n , s n 5j^+ is a well defined generalized 
function on U with values in V n . 

Proof. Thanks to the isomorphism 3x we have to determine the space: 

(61) G C'°°(A X , V n ) I i>\ AxU0} = and (p(X) + yp{X))^y) = 0}. 
Let ^ e C~°°(A X , V n ). We write: 

n 

(62) lKv)=X>i(l/K 

i=0 

where ^ G C~°°(Ax) and (fj)o<j< n is the basis defined in section 4.5. We put: 

(63) 6k{y)= {^y 6x{y) - 

Since ip is supported in A/" and Ax fl A/" = {X}, there exists G R, all equal to zero 
but for finite number, such that: 

(64) = (v)- 

ken 

For n = 0, we have p = and the condition (p(X) + yp{Y))ip(y) = is automatically 
satisfied. 

For n > 1, we put ctj = (ra — % + l)i We have yS°(y) = and for k > 1, yS k (y) = 
-k5 k -\y). Thus: 

(65) a iife <5 fe (?/)^ + i - a^a^M^ -1 ^)^-! = 0. 

0<i<n-l,feeN l<j<n,fc>l 

It follows: 

a n _i ifc = for fc > 0; 

(66) { ai, k = for k > 1; 
aj_i 5 fc = (A; + l)(i + l)(n — i)aj + i 5 fc + i for n > 2, 1 < i < n — 1 and k > 0. 

It follows in particular 

(i) from the first and the last relations that Wi, k > with 2i+l < n: a n -(2i+i),fc — 0; 

(ii) from the last relation that Wi > with 2i < n, (a„-2i,fc)fc>o is completely deter- 
mined by (a n , k )k>o- 

We distinguish between the two cases according to the parity of n. 
n even: In this case, for n > 2, the second relation follows from (i). Hence the map: 
{V G C-°°(A X , V n ) /^\a x \ { o } = and (p(X) + yp(Y))^(y) = 0} - R N 

( 67 ) ^(y) = 5^ a i,k$ k (y)vi i-> (a„,fc)fceN 

0<j<n,A:eN 

is bijective. This is also true for n = 0. 
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n odd: It follows from the two last relations that for k > i > 1 a 2 i-i t k = 0. In 
particular, the map: 

(68) 

G C-°°(A X , V n ) I if>\ Axm = and (p{X) + yp(Y))^(y) = 0} - 

^(v) = Yl a i,k$ k (y)vi i-> (a n , ,...,a n n_i) 

0<i<n,keN 

is bijective. 

This proves the first part of the theorem on the dimension of S n {U). It remains 
to prove that the functions n k (s n 6tf) form a basis of S n (U). We have for ip(y) = 

n 

E E a hk 5 k {y) Vl E C-°°(A X , V n ) such that p(X + yY)^{y) = 0: 

n—l 

n x 4>(y) = (3 + p(if ) + 2yd Y ) ^ a n , fe <5 fc+1 (?/X + ^ . . . Vi 
(69) keN ni i= ° 

= J^(ra - 2A; - l)a n , fe 6 fc+1 (yK + ^ • • • ^ 

feeN i=0 

where . . . are elements of C~°°(Ax)- 

n even: Since v n = X% , we have (s n Sj^)x(y) = o~x(y)X% . By induction on k, it follows: 

(□ fc ( Sn 5 A r)) x (y) = (n - 2* + 1) . . . (n - l)5 fc (l/)Xf 

+ terms with I^^ for i > 1. 

Since n is even n-2fc + 1^0. The result follows. 

n og?g?: Since t> n = e®X^2~, we have (s n Sj^)x{y) = o~x(y)(e<S> X~z~). By induction on 
k, it follows: 

(□ fe (s n M) x (y) = (n - 2* + 1) . . . (n - l)5 fc (y)(e ® X V) 

+ terms with e£g>X^~~ l for i > 1. 



In this case for k = n — 2/c + 1 = 0. Thus, since □ fc (s„<5_A/) is invariant, it follows 

□ 



2 

from the isomorphism (68) that for k > □ fc (s„(V) = 0. The result follows. 



4.8. Global version. Let U be an open subset of sl(2, M). We put: 

(72) S° n (U) = {0eC-°° (W,\/ n r [(2 ' M) /0U{o} = O}; 

(73) <S±(W) = {0GC-°°(W,V;r [(2 ' M) /0U(^u { o})=O}. 

Theorem 4.2. LetU be an SX(2,IR) -invariant open subset of $1(2, M). Then we have: 
(i) 

m] (S° n (U) = {0} z/0^W; 

1 ' \S Q n (U) ~ (K®S(s((2,M))) s[(2 ' R) !/0eW. 
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(ii) When n is even, we have: 

(75) S n {U) = S°(U)®Vect{n\ S J M+ )\ u /keN}®Vect{n k (sJ M -)\ u /keN} 

(76) S±(W) = S° n (U)®Yect{D k (s n 5 M ±)\ u /keN} 

(iii) When n is odd: 

(77) S n {U)=S±{U) = Sl{U) 

Proof, (i) It follows from Theorem 3.1. 

(ii) When n is even, the function is defined on sl(2,R), the function s n is defined 
on M and the product s n 5^± is well defined (cf. Remark of Theorem 4.1). Then the 
result follows from Theorem 4.1. 

(iii) Let n be odd. We assume that U fl Af ^ 0. Since U is SL(2, M)-invariant, we have 
A/" + cWor M~ C W. We assume that A/" + C U (the case W C M~ is similar). 

Let G C'°°{U, \/) st(2 ' R) . Let W cWbea suitable neighborhood of X where S\ (and 
thus s n ) is defined (cf. section 4.6). There exists ( ) G K 2 such that on U 

(cf. Theorem 4.1): 

n + 1 n+1 
2 2 

(78) 0(Z) = ^a fe D fe (s n (Z)^ + (Z)) =^a fc D fc (( Sl (Z)®Z^)5 Ar+ (Z)). 

k=0 k=0 

Since //i : Vi \ {0} — > A/" + is a non trivial two-fold covering, there is not any continuous 
section. In other words there is not any continuous SL(2, M)-invariant map s : A/" + — > V\ 
such that for any Z G U , s(Z) = S\(Z). Thus = 0. The result follows. 

□ 

5. Invariant solutions of differential equations 

5.1. Introduction. Let C v = (End(V) <g> S(sl(2, R)))< 2 ^ be the algebra of End(V> 
valued invariant differential operators with constant coefficients on q. It is the classical 
family algebra in the terminology of Kirillov (cf. [KirOO]). When V — V n is the (n+ 1)- 
dimensional irreducible representation of s((2,R), we put C n = Cy n . 

Let U C s[(2, R) be an open subset. It is a natural and interesting problem to deter- 
mine the generalized functions G C~°°(W, y) s[ ( 2 ' R ) such that Cy<\> is finite dimensional. 

We recall that S($l(2, R)) s[ ^ = R[D]. It is a subalgebra of C v . An other subalgebra 
of C v is End(\/) st(2,R) - When V = V n , we put: 

(79) M n = p n (X)Y + Pn (Y)X + \ Pn {H)H G C n 

According N. Rozhkovskaya (cf. [Roz03]), C n is a free S(sl(2, R)) 5l ( 2 ' R )-module with basis 
B n = (l,M n ,...,(M n ) n ). 

Lemma 5.1. Let G C _00 (W, \/) s[(2 ' M) . T/ien we have: 

(80) dim M (C y 0) < oo dim R (R[D]0) < oo 

Proof. We argue as in [Roz03]. Let H be the set of harmonic polynomials in S(sl(2, 
Then, 5(51(2, R)) = R[D] <g> # (cf. [Kos63]), and: 

(81) CV = R[D]<g> (H ®End(V)Y i{m . 
Since dim R (iJ <g> End(\/)) S ' (2 ' R) < oo, the result follows. 
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□ 

Remark: Since R[D] C R[D] <g> End(V) s[(2 ' M) C C v , the condition dim{C v <f)) < oo is 
also equivalent to the existence of r G N and (A , . . . , A— 1) £ ( End(\/) s[(2 ' M) ) r such 
that: 

(82) (D r + A r _iD r_1 + . . .AiD + A )(f> — 0. 

Useful examples of (82) are (□ — A) fc = for A G C and generalized functions with 
values in a complex representation. We give such an example below. 

Definition 5.1. Let G C _00 (W, \/) s((2 ' R) . J^e say too* D-^mte i/ dim R (R[D]0) < 
oo. 

In other words, is D-finite if there exists r G N and (a , . . . , a r _i) G R r such that 

(83) (LT + a r _iLT _1 + . . . a ± n + a o )0 = 0. 



Example: (This was our original motivation to study this problem.) Let g = g © 0i 
be a Lie superalgebra. We define the generalized functions on g as the generalized 
functions on g with values in the exterior algebra A(g^) of 

(84) C- oo (g) d = f C- oo (g o )®A(0l) =C-°°( o,A(0D)- 

We assume that g has a non degenerate invariant symmetric even bilinear form B. Let 
VL G S 2 (q) be the Casimir operator associated with B. We have f2 = f2 + ^i with 
fio G ^(flo) and fii G A 2 (gi). We consider fix as an element of End(A(g^)) acting 
by interior product. When they can be evaluated (cf. for example [Lav98, Chapitre 
III. 5]), the Fourier transforms of the coadjoint orbits in g* are invariant generalized 
functions on g subject to equations of the form (Q — A)0 = with A G C. It can be 
written (fi + (^i - A))0 = (for g = s((2,R) it is of the form (82) with fi = □ and 
A) = &i — A). We have: 

(85) (n -A)* = X;(J)(n-A)*(-n 1 )*-*. 

i=0 

For k > ^Sil, we have fij = 0. It follows that for k > 1 + we have: 

(86) (n - A) fe = 0. 
this equation is of the form of (82). 

5.2. Generalized functions with support {0}. We immediately obtain from Theo- 
rem 3.1 

Theorem 5.1. Let V be a representation o/sl(2,R). Let G C -00 (st(2, R), \/) s[(2 ' R) suc/i 
t/ioi 0| s i(2,M)\{o} — and zs H-finite. Then, we have = 0. 
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5.3. Support in the nilpotent cone: local version. 

Theorem 5.2. Let nGN. Let V n be the irreducible n + 1- dimensional representation of 
sl(2, K). Let W be a finite dimensional vector space with trivial action of sl(2, M). Let U 
be an open connected neighborhood of X such that the function s n is well defined onU\~\N 
(cf. section 4.6) and3 x is bijective (cf. section 4.2). Let G C~°°(W, W <g> \/ n ) s[(2 ' M) such 

that (p\u\M = 0. Let r G N and (a , . . . , a r _i) G IR r such that: (D r +J2 a kO k )0 = 0. 

^ k=0 ' 

Then, we have = when at least one of the following conditions is satisfied: 

(i) n is even; 

(ii) n is odd and ao 7^ 0. 

Proof. Let G C~°°(U, W <g> \/ n ) sl(2 ' R) such that 0| wvv - = 0. From Theorem 4.1 we obtain 
that there exist p G N, with p = if n is odd and (w , . . . , w p ) G such that: 

p 

(87) <f) = Y,Wi®O i {s n 5 M+ ). 

i=0 

Then: 

(i) When n is even, for < j < p + r, we have a^Wi = 0. 

(ii) When n is odd, for < j < we have Yl a kWi = 0. 

k+i=j 

The result follows. 

□ 

Remark: When n is odd, in contrast with the classical case (V = V is the trivial 
representation) there exist (in a neighborhood of X) non trivial locally invariant solutions 
of the equation D fc = supported in the nilpotent cone! For example, if k > the 
functions = n i (s n 5j^+) for < i < are not trivial, supported in the nilpotent cone 
and satisfy the equation D fc = 0. 

When we consider the equation (□ — A) fc = for A G C\{0}, then the trivial solution 
is again the only one supported in the nilpotent cone. 

5.4. Support in the nilpotent cone: global version. 

Theorem 5.3. Let V be a real finite dimensional representation o/s((2,R). LetU be an 
SL(2,R) -invariant open subset o/st(2,R). Let G C -0O (W, V) sl(2 ' R *> such that <p\ u \M = 
and is D-finite. Then we have = 0. 

Proof. It is enough to prove the theorem for V irreducible. Then, the result follows from 
Theorem 4.2, Theorem 5.2 and Theorem 5.1. □ 



6. General invariant generalized functions 
6.1. Main theorem. 

Theorem 6.1. Let V be a real finite dimensional representation o/sl(2,R). LetU be 
an SX(2,R) -invariant open subset o/sI(2,R). Let G C~°°(W, V) Bl{2 ' R) such that is 
D-finite. Then determined by <p\u\M and <fi\u\N is an analytic function. 
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Proof. The fact that is determined by 4>\u\N follows from Theorem 5.3. The fact that 
4>\u\Af is analytic can be proved exactly as in [HC65]. 

□ 

Remark: In general will not be locally L 1 . Indeed, let O e C~°°(st(2, R)) Bi( - 2 ^ a 
non zero D-finite generalized function. Then O is locally L 1 , but for k G N*: 

(88) M n fc o G C-°°( 5 [(2,M),End(V;)) St(2 ' M) 
is usually not locally L 1 . 

6.2. Application to the SuperpfafRan. Let us consider the Lie superalgebra g = 
spo(2,2n). Its even part is g = sl(2,R) ©so(2n, R). Its odd part is 0i = Vi © W where 
is the standard 2n-dimensional representation of so(2n, R). 

In [Lav04] we constructed a particular invariant generalized function Spf on spo(2, 2n) 
called Superpfaffian. It generalizes the Pfaffian on so(2n, R) and the inverse square root 
of the determinant on sl(2, M). As it is a polynomial of degree n on so(2n, R), we may 
consider that we have: 

/ n \ sl(2,R) 

(89) Spf eC-°°^I(2,R), © o 5 fe (so(2n,M)*) ®A( t)J 

Let Q (resp. □, fig, Qi) be the Casimir operator on spo(2,2n) (resp. on s[(2,lR), 
so(2n, R), fli). Then Q = □ + fi' + fi a and 

/ n \ sl(2,K) 

(90) n'o + Qi e End ^ ® o S k (so(2n,R)*) ®A(flt)J 

is a nilpotent endomorphism. The superpfaffian satisfies: 

(91) (□ + (ft' + Qi)) Spf = ft Spf = 0. 

The function Spf is analytic on s((2,R) \Af and in [Lav04] an explicit formula is given 
for Spf(X) G © S k (so(2n,R)*) ©A( *) with X G si(2,R) \ M. However, since Spf is 

fc=0 

not locally L 1 (cf. [Lav04]), it is not clear whether Spf is determined by its restriction 
to $1(2, M.) \ M or not. In [Lav04] we proved that Spf is characterized, as an invariant 
generalized function on $1(2, R), by its restriction to s\(2, R)\M and its wave front set. 
From the preceding results we obtain this new characterization of Spf: 

/ n \ sl(2,M) 

Theorem 6.2. Let <\> G C-°°(s[(2,M) , ^© S k (so(2n,R)*) ©A(flt)J such that: 

(i) for X Gst(2,R)\Af ; <j>{X) = Spf (AT) G © S k (so(2n,R)*) ® A(q* 1 ); 

(ii) Q(p = 0. 
Then we have = Spf. 
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